Session 10: Corpora and Evaluation

This session on corpora and evaluation was composed of two distinct parts. Before the break, four papers dealing with a range of important aspects of evaluation of written language systems and spoken language systems were presented. A printed version of each of these papers is included in the conference proceedings. After the break, a series of informal reports (not included as proceedings papers) were given summarizing the work of the Corpora and Performance Evaluation Committee (CPEC) of the DARPA Spoken Language Systems (SLS) Program, with specific reports from several working groups which have been dealing with various aspects of corpora collection and performance evaluation in the SLS Program. A lively and extended discussion followed these working group reports, including presentations of a number of alternate viewpoints.